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DEVELOPMENT  AND  VALIDATION  OF  THE  AIR  FORCE- 
TECHNICAL  TRAINING  STUDENT  SURVEY 


I.  INTRODUCTION 

To  accomplish  its  mission,  the  Air  Force 
requires  large  numbers  of  skilled  persoimel 
specially  trained  to  operate  arid  maintain  a highly 
technical  force.  To  ensure  that  these  technicians 
are  trained  in  the  skills  needed  and  are  available  in 
the  numbers  necessary,  the  Air  Force  must  invest 
considerable  financial  and  human  resources  in  a 
diverse  and  responsive  teclinical  training  program. 
Air  Force  teclmical  training  is  conducted  under 
the  auspices  of  Air  Training  Command  (ATC), 
whose  primary  function  is  to  provide  the  required 
number  of  technically  skilled  people  necessary  to 
keep  the  Air  Force  in  a state  of  operational 
readiness. 

In  1972,  ATC  began  to  experience  an  unaccept- 
able increase  in  the  rate  of  student  attrition  from 
Air  Force  Technical  Training  (TT).  In  response  to 
this  rise  in  attrition  rates,  ATC/TT  requested  that 
the  Personnel  Research  Division,  Air  Force  Human 
Resources  Laboratory,  prepare  a briefing  com- 
paring the  aptitude  levels  of  the  1971  and  1972 
enlisted  accessions.  This  was  to  determine  if  any 
significant  changes  in  input  quality  had  occurred 
and,  if  so,  whether  these  changes  could  account 
for  the  increases  in  attrition.  Data  presented  at  the 
briefing  and  previous  experience  with  the  technical 
training  system  led  ATC  to  conclude  that  aptitude 
was  not  the  sole  driving  factor  behind  increased 
attrition  rates.  Therefore,  ATC  initiated  a Request 
for  Personnel  Research  (RPR-72-26)  to  have  the 
Personnel  Research  Division  investigate  student 
attitudes  towards  Air  Eorce  technical  training  and 
the  relatronship  between  those  attitudes  and 
performance  (most  importantly  attrition)  in 
technical  training  courses.  This  study  would 
involve  a multiphase  research  effort  designed  to  (a) 
produce  a valid  measurement  instrument  for 
obtaining  student  attitudes,  (b)  compare  and 
contrast  student  attitudes  at  various  training 
centers  and  in  courses  having  differing  attrition 
rates,  and  (c)  assess  the  relationship  between  atti- 
tudes and  performance  in  general,  and  attitudes 
and  performance  in  particular  training  Courses. 
This  report  will  document  the  development  and 
validation  of  the  attitudinal  measurement  instru- 
ment while  subsequent  reports  will  document  the 
later  stages  of  this  overaU  effort.  Therefore,  the 
objectives  of  this  study  were  to  develop  and  assess 
the  validity  of  a methodology  to  obtain  student 


attitudes  concerning  their  Air  Force  technical 
training  experience . 


a METHOD 

Subjects 

A sample  of  12,666  nonprior  service  oilisted 
accessions  (10,980  males  and  1,686  females) 
provided  the  ^ta  base  used  in  this  study.  All 
subjects  entered  the  Air  Force  between  1 June 
1973  and  31  December  1975  and  attended  classes 
at  one’ of  the  Air  Force  Technical  Training  Centers 
during  this  time  period.  Further  delineation  of 
sample  and  subject  characteristics  wdl  be 
presented  at  a later  point. 

Development  of  Assessment 
Instruments 

An  extensive  review  of  the  literature  was 
conducted  regarding  motivation,  expectancy, 
training  and  organizational  theories,  job  satis- 
faction, and  the  relationship  between  these  type 
variables  and  performance/attrition  in  technical 
training.  As  a result  of  this  review,  it  was  decided 
that  a satisfactory  instrument  should  tap  student 
attitudes  in  the  following  areas:  (a)  expectancy 
about  the  technical  training  experience;  (b) 
importance  of  diose  expectancies;  perception  of 
instructor  personnel,  both  in  terms  of  (c)  com- 
petence and  (d)  instructor-student  relations;  (e) 
perception  of  feUoy  students;  (f)  degree  of  organi- 
zational control;  (g)  degree  of  stress  in  the  training 
environment;  (h)  quality  of  training  piaterials;  (i) 
perception  of  the  physical  setting;  0) 
satisfaction  with  the  training  experience  and  (k) 
overall  career  choice.  In  addition  to  these  11 
factors,  it  was  decided  to  employ  the  Porter- 
Lawler  (1968)  model  of  occupational  motivation 
and  genemte  a “Motivatiohal  Force”  measure  by 
combining  the  student’s  expectancies  about  the 
training  experience  and  the  importance,  or 
valence,  of  those  expectancies  to  the  stu^nt. 
Thus,  a total  of  12  separate  attitudinal  measures 
would  be  obtained  from  each  respondent.  Each 
separate  factor  would  be  represented  in  the  final 
instrument  by  a separate  scale. 

An  item  pool  of  approximately  300  items  was 
prepared  and  tested,  using  a sample  of  300 
students  selected  from  different  technical  training 
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courses.  Technical  screening  and  judgemental 
Otort  techruques  were  used  to  eliminate  items, 
and  a final  instrument,  the  Technical  Training 
Student  Survey  (TTSS),  was  developed  by  Lt  Col 
C.  G.  Secrist.  The  TTSS  contains  12  scales 
composed  of  a total  of  121  items;  however,  since 
certain  items  require  double  responses,  each 
subject  makes  147  responses.  The  scales  and 
numbers  of  items  in  each  scale  are  presented  in 
Table  1.  The  items  composing  each  scale  are 
presented  in  Appendix  A. 

For  scoring  purposes,  item  options  were  coded 
from  I through  5.  A value  of  5 represented  tlie 
positive  anchor  of  the  option  continuum  while  a 
value  of  1 represented  the  negative  anchor  point. 
For  example,  for  item  #1  (see  Appendix  A),  a 
response  of  "Very  likely”  would  be  coded  as  5 
while  a response  of  “Very  Unlikely”  would  be 
coded  as  I.  IMth  the  exception  of  the  Motivational 
Force  scale,  an  individual’s  scale  score  was  derived 
by  the  summation  of  his  item  responses  per  scale. 
For  the  Motivational  Force  scale,  an  individual’s 
scale  score  was  obtained  by  summing  the  products 
of  each  scale  1 item  by  its  partner  scale  2 item. 
Approximate  testing  time  for  the  TTSS  is  30 
minutes.  A copy  of  the  TTSS  is  presented  in 
Appendix  B. 


Table  I.  Technical  Training 
Student  Survey-Scales 


Seal* 

Number 
of  Itamt 

1 . Motivational  Expectancy 

26 

2.  Motivational  Valence 

26 

3.  Motivational  Force 

26 

4.  Instructor  Task  Competence 

10 

5.  Instructor  Personal  Relations 

lO 

6.  Fellow  Students 

10 

7.  Organizational  Control 

15 

8.  Training  Stress 

15 

9.  Training  Materials 

10 

10.  Physical  Setting 

18 

1 1 . Global  Training  Satisfaction 

3 

12.  Career  Choice  Satisfaction 

4 

In  addition  to  the  TTSS,  eight  other  inventory 
forms  were  developed  to  provide  information 
useful  in  later  phases  of  the  overall  research  effort. 
A listing  of  these  forms  and  the  information  they 
were  designed  to  provide  is  presented  m Table  2. 
Each  form  is  presented  in  Appendix  B.  A total 


Table  2.  Additional  Assessment  Forms 


Form  Namo  Numbar  Information  Omirod 


1.  Student  Control  Data 

2.  Instructor  Control  Data 

3.  Student  Performance  Assessment 

4.  Student  Training  Records 

5.  Student  Remedial  Training 

6.  Student  Elimination 

7.  Instructor  Performance  Assessment 

8.  Student  Peer  Rating 


Fm  1632  bio/demographic  data 

Fm  1633  bio/ demographic  data 

Fm  1634  student  and  instructor  ratings  of 

student  performance  in  class 
Fm  1635  time  required  (for  self-paced)  or 
flnal  course  grade 

Fm  1636  need  for  remedial  instruction 

Fm  1637  reason  for  attrition 

Fm  1638  supervisor  rating  of  instructor 

Fm  1639  rating  of  fellow  students 


nitvey  package  was  composed  of  the  TTSS  and  the 
other  eight  forms.  All  forms  were  produced  so  that 
after  administration,  data  could  be  retrieved  by 
electronic  optical  scaimings. 

S«npifaig  Strategy 

Before  corutruction  of  the  sampling  plan, 
several  major  sampling  objectives  were  identified. 
Rnt,  the  sample  had  to  be  sufficient  in  scope  and 


numbers  to  allow  for  (a)  the  development  of 
normative  values  for  tlie  Air  Force  technical 
training  system  as  a whole,  (b)  the  development  of 
normative  values  for  individual  Air  Force 
Technical  Training  Centers,  and  (c)  providing 
reasonably  good  estimates  of  normative  values  for 
many  specific  technical  training  coursed.  This 
would  necessitate  sampling  large  numbers  of 
students  attending  many  different  courses  at 
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various  Air  Force  Technical  Training  Centers. 
Second,  selection  of  the  sample  should  also  allow 
later  comparisons  between  students  from  courses 
having  disparate  attrition  rates;  i.e.,  subjects  from 
both  high-  and  low-attrition  courses  had  to  be 
included.  Finally,  in  order  tb  study  later  the 
impact  of  attitudes,  holding  aptitudes  constant, 
subject  selection  had  to  be  made  with  respect  to 
the  “Selector  Aptitude  Requirements”  for  the 
various  courses.  With  consideration  given  to  these 
major  goals  and  other  factors  such  as  student  flow, 
number  of  blocks  of  instruction  per  course,  and 
whether  the  course  was  “self  paced”  or  “lock 
step,”  a final  sampling  .plan  was  devised.  This  plan 
projected  data  collection  from  approximately 
14,000  subjects  attending  one  of  53  different 
courses  .at  one  of  five  different  Air  Force 
Technical  Training  Centers. 


Survey  Administration 

A set  of  istrative  instructions  for  ihe 
various  ar  instruments  in  the  survey 

prackage  d to  facilitate  standardizing 

admin  i inents  were  made  with  the 

ATC  Research  Applications  Branch 

servici  ii  center  to  provide  the  personnel 
necessaiy  for  tlie  survey  administrations.  Surveys 
were  administered  to  (Afferent  subgroups  of 
subjects  at  selected  points  during  the  training 
semester.  It  was  found  that  in  almost  all  cases, 
maximum  subject  cooperation  was  obtained  and 
few  problems  developed. 


in.  RESULTS  AND  DISCUSSION 
Processing  of  Forms 

Completed  survey  forms  were  returned  for 
processing.  Forms  were  checked  for  compliance 
with  directions,  then  optically  scanned  into 
electronic  data  fUes.  A distribution  was  produced 
showing  the  number  of  TTSS  forms  with  missing 
entries  and  the  number  of  omissidns*p>er  form.  All 
TTSS  forms  with  seven  or  more  response  omits 
(out  of  a possible  147)  were  discarded  from 
further  processing.  Any  remaining  form  would 
then  have  a maximum  of  4.76%  missing  data;  95% 
of  the  forms  contained  complete  response  sets.  To 
facilitate  analysis,  scale  midpoint  values, 
representing  a neutral  oprinion,  were  inserted  to 
replace  all  missing  data.  After  the  data  reduction 
and  cleanup,  a sample  of  12,666  subjects 
remained.  A breakdown  of  the  total  samp)le  by  Air 
Force  Technical  Training  Center  and  course  is 
presented  in  Table  3. 

For  the  total  sample,  scale  midpoints,  the 
observed  range  of  scale  scores,  and  scale  score 
means  and  standard  deviations  are  presented  in 
Table  4.  Before  a test  can  be  considered  psycho- 
metrically  sound,  it  must  first  be  shown  to  bf  a 
reliable  source  of  measurement.  Internal  con- 
sistency measures  are  often  used  as  a good 
estimate  of  test  or  scale  reliability.  Possible  values 
for  this  measure  range  from  a maximum  of  1 .00, 
p)erfect  internal  consistency,  to  a minimum  of  0.0, 


Table  3.  Number  of  Students  by  Course 


j 


Tacenlul  Training  Cantar 


Chinuta 

KaaUar 

Lackland 

Lowry 

Shappard 

CoMita 

N 

Caurta 

N 

Couna 

N 

Couiaa 

N 

Couna 

N 

30230 

102 

20731 

314 

30630 

267 

20630 

25 

29130 

216 

31630 

174 

27630 

546 

81130 

1,310 

31631 

175 

36130 

90 

32530 

216 

29333 

133 

81230 

902 

32130 

106 

36231 

225 

32531 

187 

30331 

196 

32231 A 

92 

36330 

281» 

42132 

151 

30332 

157 

32231Q 

129 

40330 

109 

42231 

163 

30333 

209 

32430 

238 

43131 

389 

42330 

313 

30430 

244 

32632 

55 

51130 

262 

42430 

138 

30431 

142 

46130 

297 

54231 

154 

43131 

404 

30434 

237 

46230 

252 

90230 

428 

43230 

492 

30534 

85 

90430 

321 

54130 

144 

32830 

187 

90530 

97 

32831 

170 

98230 

78 

32833 

208 

32834 

182 

70230 

398 

73230 

276 

Total  2,484 


3,684 


2,479 


1,369 


2,650 


Table  4.  Riychoinetric  Characteristics  of  the  Technical 
Training  Student  Survey 
Total  Sample  (N  = 12,666) 


Sell* 

SCMl9 

Midpoint 

ObMnrod 

Ran0O 

Main 

SD 

Co«fflcUnt 

Alpha 

Standard 
Error  of 
Maaturomant 

1.  Motivational  Expectancy 

78 

26-130 

93.50* 

17.25 

.90 

5.40 

2.  Motivational  Valence 

78 

26-130 

105.02* 

14J1 

.88 

4.98 

3.  Motivational  Force 

338 

26-650 

394.78* 

103.94 

.91 

30.77 

4.  Instructor  Task  Competence 

30 

10-50 

42.68* 

7.09 

.92 

2.01 

S.  Instnictor  Personal  Relations 

30 

10-50 

41.03* 

7.60 

.93 

2.04 

6.  Fellow  Students 

30 

10-50 

33.29* 

7.94 

.79 

3.60 

7.  Organizational  Control 

45 

15-75 

36.78*’ 

10.47 

.82 

4.40 

8.  Training  Stress 

45 

15-75 

38.52*’ 

11.38 

.86 

4.21 

9.  Training  Materials 

30 

10-50 

34.76* 

7.10 

.76 

3.51 

10.  Physical  Setting 

54 

18-90 

63.36* 

11.52 

.83 

4.77 

11.  Qobal  Trairung  Satisfaction 

9 

3-15 

11.20* 

2.69 

.64 

1.62 

12.  Career  Oioice  Satisfaction 

11 

2-20 

12.66* 

4.27 

.75 

2.12 

^Indicates  obtained  mean  ia  significantly  (Bonferroni  (ot  - .01))  greater  than  scale  midpoint  (neutral  opinion). 
^Indicates  obtained  mean  is  signifiacntly  less  than  scale  midpoint  (neutral  opinion). 


indicating  no  internal  consistency.  Internal  con- 
sistency values,  expressed  as  Cronbach’s  Alpha, 
and  the  standard  enor  of  measurement  for  each 
scale  of  the  TTSS  are  presented  in  Table  4.  These 
values  range  from  a maximum  of  .93  (Instructor 
Personal  Relations)  to  a minimum  of  .64  (Qobal 
Training  Satisfaction).  The  low  coefficient  for  the 
Global  Training  Satisfaction  scale  might  reflect  the 
fact  that  this  scale  has  very  few  items  (3).  Never- 
theless, a value  of  .64  is  not  so  low  as  to  preclude 
the  use  of  the  scale.  With  the  exception  of  the 
Global  Training  Satisfaction  scale,  values  obtained 
for  the  internal  consistency  coefficients  of  other 
scales  were  quite  satisfactory  and  lead  to  the 
conclusion  that  consistent  measurement  by  these 
TTSS  scales  occurs  in  the  technical  training 
population. 

In  interpreting  scale  scores  and  scale  score 
means  of  this  study,  a few  guidelines  are  useful. 
For  most  scales,  a value  above  the  scale  midpoint 
reflects  a positive  attitude  while  a value  below  the 
midpoint  reflects  a negative  attitude.  The 
exceptions  to  this  general  rule  involve  scales  7 
(Organizational  Control)  and  8 (Training  Stress). 
For  these  scales,  a value  higher  than  the  midpoint 
reflects  either  perceived  over-control  or  stress 
while  a value  below  the  midpoint  reflects  either 
perceived  under-control  or  stress.  Since  the  rela- 
tionships between  these  measures  and  other 
variables,  such  as  performance,  are  not  yet  well 
documented,  care  should  be  exercised  in  the 
interpretation  of  these  scales.  However,  certain 
statistical  techniques  can  aid  in  the  interpretation 
of  these  survey  results. 


T-tests  were  accomplished  to  identify  scale 
score  means  significantly  greater  than  or  less  than 
the  scale  midpoints  (neutral  opinions).  The  results 
of  those  tests  are  summarized  in  Table  4.  (For  this 
and  all  the  foUowing  statistical  comparisons,  the 
Type  I Error  Rate  [the  probability  of  inconectly 
accepting  the  statistical  significance  of  a 
difference]  was  controlled  per  family  of  com- 
parisons; i.e.,  the  total  error  rate  per  famDy  <a.  In 
this  case,  using  the  Bonferroni  Technique  (Miller, 
1966)  the  total  Type  1 Error  Rate  [a]  for  all  12 
scale  comparisons  was  < .01 . In  all  following  cases, 
the  reported  error  rate  will  be  for  that  family  of 
comparisons  under  discussion.)  Among  the  total 
sample  scale  score  means,  all  means  except  those 
for  7 (Organizational  Control)  and  8 (Training 
Stress)  were  found  to  be  significantly  greater  than 
the  scale  midpoints.  This  indicates  that,  as  a group, 
technical  training  students  reflected  positive  atti- 
tudes regarding  the  technical  training  environment 
and  were  satisfied  with  both  the  global  training 
experience  and  their  particolar  career  choices. 

The  interscale  correlation  coefficients  obtained 
from  the  total  sample  are  presented  in  Table  5. 
For  the  most  part,  the  values  reflect  only  low  to 
moderate  relationships  among  the  scales.  Certain 
exceptions  include  the  correlation  of  scale  3 
(Motivational  Force)  with  scales  1 (Motivational 
Expectancy)  and  2 (Motivational  Valence).  These 
high  intenelationships  should  be  expected  both 
because  of  the  logical  and  empirical  relationships 
of  these  particular  scales.  Other  exceptions  include 
a high  correlation  (.76)  between  4 (Instmctor  Task 
Competence)  and  5 (Instructor  Personal  Relations) 
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and  a moderately  high  correlation  (.68)  between 
11  (Gobal  Trairting  Satisfaction)  and  12  (Career 
Choice  Satisfaction).  These  relationships  should 
also,  logically,  be  expected  to  be  moderately  high. 

Finally,  there  is  a moderate  relationship  (.59) 
between  Organizational  Control  and  Training 
Stress,  and  a moderate  negative  relationship  (—.61) 
between  Training  Stress  and  Training  Materials. 
These  relationships  were  not  fully  expected  and 
should  be  explored  in  more  cktail  in  future 
research.  The  remaining  inter-scale  correlations  are 
relatively  small,  and  this  may  be  interpreted  as 
being  a positive  feature  of  the  test  instrument.  In 
general,  it  appears  as  though  the  different  scales 
are  tapping  essentially  different  aspects  of  the 
technical  training  experience. 

Summarizing  the  results  presented  thus  far,  it 
would  appear  that  based  on  considerations  of 
range,  variance,  mean  scores,  and  reliability  esti- 
mates, the  scales  of  the  TTSS  are  psychometrically 
suitable  for  effective  use.  However,  the  usefulness 
of  this  instrument  is  dependent  not  only  upon  its 
psychometric  r.oundness,  but  also  on  its  validity; 
Le.,  having  a relationship  to  student  performance 
in  Air  Force  technical  training.  To  assess  this 
relationship,  the  total  sample  group  was 
subdivided  into  a “Graduate  Group,”  composed  of 
11,423  subjects  who  had  successfully  completed 
technical  training  courses,  and  an  “Eliminee 
Group,”  composed  of  1,243  sul^ects  who  were 
not  successful  in  technical  training  and  were 
etiminated  before  the  completion  of  their  training 
courses.  For  the  Eliminee  Group,  reasons  for 
termination  and  the  percentages  of  elittunees  in 
each  category  of  elimination  are  presented  in 
Table  6.  A casual  inspection  of  this  table  leads  to 
the  conclusion  that  this  group  is  a rather  typical 
sample  of  Air  Force  technical  training  eliminees.  If 
it  can  be  shown  that  the  TTSS  differentiates 
between  this  group  of  eliminees  and  the  group  of 
graduates,  then  it  may  be  concluded  that  there  is  a 
relationship  between  the  TTSS  and  performance  in 
the  technical  training  environment. 


The  scale  score  means  and  standard  deviations 
for  both  the  Graduate  and  Eliminee  Groups  are 
presented  in  Table  7.  To  test  whether  the  observed 
differences  between  the  means  ^'e  statistically 
significant,  T-tests  were  performed.  These  tests  are 
summarized  in  Table  7.  It  was  found  that  the 
Graduate  Group  scale  means  were  significantly 
higher  than  the  Eliminee  Group  scale  means  for 
the  fcllowing  scali ' ' 2 (Motivational  Valence),  4 
(Instructor  Task  Competence),  5 (Instructor 
Personal  Relations),  9 (Training  Materials),  11 
(Global  Training  Satisfaction),  and  12  (Career 
Choice  Satisfaction).  The  Eliminee  Group  scale 
means  were  found  to  be  significantly  higher  than 
the  Graduate  Group  for  the  7 (Organizational 
Control)  and  8 (Training  Stress)  scales.  No 
significant  differences  were  fc  ind  for  1 (Motiva- 
tional Expectancy),  3 (Moti.ational  Force), , 6 
(Fellow  Students),  or  10  (Ph  .rical  Setting).  Using 
the  interpretative  guidelines  previously  given,  these 
findings  might  be  interpreted  as  follows:  (a)  there 
was  no  difference  between  the  expectations  of  the 
graduates  and  eliminees,  but  the  graduates  attri- 
buted more  valence,  or  importance,  to  those 
expectations,  (b)  the  graduates  had  more  positive 
attitudes  regarding  the  instructors,  both  in  terms 
of  competence  and  personal  relations,  (c)  there 
was  no  difference  in  the  perception  of  fellow 
students,  but  eliminees  perceived  more  organiza- 
tional control  and  stress,  graduates  also  had  a more 
positive  attitude  towards  the  training  materials, 
but  there  were  no  diffc  '■ences  between  the  groups’ 
perception  of  the  physical  setting,  and  (d) 
graduates  were  more  satisfied  with  both  their 
training  experience  and  overall  career  choice. 
Summarizing  these  differences,  the  graduates 
thought  the  training  experience  more  important, 
saw  their  instructors  as  being  more  competent  and 
personable,  felt  less  control  and  stress,  and  were 
more  pleased  with  their  training  and  career  choice 
than  were  eliminees. 

The  finding  of  significant  differences  between 
the  respoiises  of  graduates  and  eliminees  is 


Table  6.  Numben  of  Eliminees  by  Category  of  Elimination 
1,243) 


Mtdlcal/ 

Psycho* 


Aootfomie  Medical  MotUatlonal  leeleai  Admin 


!•  709 

57 

117  9 

177 

14 

94 

8 

49 

Miftoai- 

lanaout 

N % 

97  8 
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Table  7.  Mean  Scak  Scofes  of  Graduates  and  Eliminees 


QraduatM  (N 

■ 11.4XJ) 

EllmInMa  (N  ■ 1.243) 

Seal* 

Mean 

SO 

Maan 

SD 

1.  Motivational  Expectancy 

93.52 

17.04 

93.33 

19.11 

34 

2.  Motivational  Valence 

105.30 

13.98 

102.49 

16.84 

5.58» 

3.  Motivational  Force 

395.64 

102.43 

386.90 

116.71 

2.54 

4.  Instructor  Task  Competence 

42.88 

6.91 

40.83 

8.34 

8.38» 

5.  Instructor  Personal  Relations 

41.25 

139 

39.02 

9.07 

837* 

6.  Fellow  Students 

33.31 

8.00 

33.13 

732 

.82 

7.  Organizational  Contrd 

36.47 

10.35 

39.62 

11.11 

9.57* 

8.  Training  Stress 

38.00 

11.24 

43.28 

11.49 

15.43* 

9.  Training  Materials 

34.91 

7.06 

3335 

7.29 

7.21* 

10.  Physical  Setting 

63.44 

1139 

62.71 

12.60 

1.96 

11.  Qobal  Training  Satisfaction 

11.40 

2.59 

938 

2.98 

22.97* 

12.  Career  Choice  Satisfaction 

13.04 

4.14 

9.17 

3.88 

33.22* 

indicates  significance;  Bonfetroni  a = .01. 


I important  in  establishing  the  validity  of  the  TTSS. 

But,  in  addition  to  the  existence  of  these  diffei 
ences,  the  pattern  of  differences  which  was  found 
^ is  also  quite  relevant.  The  fact  that  no  differences 

were  found  in  perception  of  fellow  students  and 
the  physical  setting,  while  significant  differences 
(in  the  directions  noted)  were  obtained  in  the 
remaining  scales,  lends  strong  logical  and  empirical 
support  to  the  conclusion  that  the  TTSS  is  related 
to  student  performance. 

To  help  assess  the  magnitude  of  the  relationship 
between  the  TTSS  and  student  performance  in 
technical  training,  a correlation  analysis  was 
performed.  Again,  graduation  versus  elimination 
from  technical  training  was  used  as  the  criterion. 
The  multiple  correlation  coefficient  between  the 
group  of  TTSS  scales,  and  the  correlation  c oef- 
ficients  between  individual  TTSS  scales  and  the 
criterion,  are  presented  in  Table  8.  Statistical  tests 
(F-tests)  were  performed  to  identify  TTSS 
measures  having  a significant  relationship  with  the 
criterion.  These  tests  are  also  summarized  in  Table 
8.  Taken  as  a set  of  scores,  the  group  of  TTSS 
scales  were  found  to  be  significantly  related  to  the 


criterion.  Additionally,  except  for  scales  (1) 
Motivational  Expectancy,  (3)  Motivational  Force, 
(6)  Fellow  Students,  and  (10)  Physical  Setting,  all 
individual  TTSS  scales  were  found  to  be  signifi- 
cantly related  to  graduation/elimination  in 
technical  training.  The  actual  correlation  values 
obtained  appear  to  indicate  somewhat  low  orders 
of  magnitude,  but  several  factors  should  be 
considered  before  interpreting  these  results.  First, 
these  values  represent  estimates  imcorrected  for 
restrictions  in  range  and  corrected  values  would  be 
somewhat  higher.  Second,  l)oth  the  dichotomous 
nature  of  the  criterion  and  the  relatively  small 
proportion  of  eliminees  in  die  sample  (circa  10%) 
are  computational  restrictions  for  this  type  of 
measure.  Finally,  even  thoug)i  somewhat  low  order 
correlations  were  found,  the  TTSS  can  still  be  a 
very  useful  test  instrument  if  it  can  be  shown  that 
the  information  obtained  from  the  TTSS  is  not 
available  from  other  sources;  i.e.,  do  the  measures 
of  the  TTSS  account  for  unique  variance  in  the 
criterion?  This  issue  was  investigated  through  a 
regression  analysis. 


Table  8.  TTSS  Scale  Validity  Correlations 


Crltarlon 


AHScaIn  1 


1J  11  IX 


Graduation/ EUmination:  (N  = i 2,666)  .33»  .00  ~.06»  -.02  -.09*  -.09*  -.01  .09»  .14»  -.06*  -.02  -.23*  .28* 

‘indicates  obuined  value  is  significant;  Bonfeironi  a = .05. 
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Tha  goal  of  this  phase  of  the  overall  research 
effort  wu  to  provl(to  an  instrument  which  could 
obtain  information  related  to  student  performance 
not  available  from  aptltudlnal  measures.  To  deter- 
mine whether  this  gosl  has  been  achieved,  the 
predictive  validity  of  a model  containing  the  TTSS 
acalea,  Airman  Qualifying  Examination  (AQE) 
/Armed  Services  Vocational  Aptitude  Battery 
(ASVAB)  scores  (M,  A.  G,  E composites),  and 
Armed  Forces  Qualification  Test  (AFQT)  scores 
was  compared  to  the  predictive  validity  of  a model 


containing  only  the  AQE/ASVAB  and  AFQT 
scores.  A significant  difference  between  these 
models  would  indicate  that  the  TTSS  adds  both 
significant  and  unique  Information  to  the 
prediction  of  graduation/eUmination  from 
training.  This  comparison  is  summarized  in  Table 
9.  A significant  difference  was  obtained  between 
the  models  and,  therefore,  it  may  be  concluded 
that  the  TTSS  is  providing  information  about 
student  performai^ce  not  available  from  apti- 
tudinal  meuures. 


nble  9.  Regression  Analysis  Summary 


Criterleii 

R*  Pull 
MedM 

PrudMon 
Pun  Modal 

R* 

Raelrlelod 

Model 

"fodloloii 

Raetilalsd 

Model 

afi 

dfs 

P lalle 

Gtaduatk>n/ Elimination 
(N  - 12,666) 

.1182 

TTSS  scales 
ASVAB  (MAGE)* 
AFQT 

.0153 

ASVAB (MAGE) 
AFQT 

12 

12,648 

122.81* 

*M*c)unlcsl,  Admlnlstntive,  Gtn«il,  Ekctronlcs. 

•p  < .01. 


IV.  CONCLUSIONS 

Summarizing  the  results  of  this  study,  it  wu 
found  that  the  TTSS  is  psychometrlcaUy  sound, 
that  strong  empirical  and  logical  evidence  exists  to 
support  a conduaion  that  the  TTSS  is  related  to 
performance  in  technical  training,  and  that  infor- 
mation obtained  from  the  TTSS  adds  significantly 
and  uniquely  to  the  prediction  of  graduation 
versus  elimination  from  technical  training.  Baud 
upon  tneu  findings,  it  may  be  conduded  that  the 
1TSS  providw  uufiil  and  important  information 
concerning  the  impact  of  attitudinal  factors  on 
student  performance  within  the  Air  Force 
technical  training  system. 
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Scale  9:  Training  Materials 
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PfMlifTeO  BY  MRC  lOWA  CITY.  lOWA  FORM  NO  38B3  W 2300 
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TECHNICAt  TRAINING  STUDENT  SURVEY 
PE  7403 

AIR  FORCE  HUMAN  RESOURCES  LABORATORY 


GENERAL  INSTRUCTIONS: 

~ 

<A'' O O <3>  C9  ® C»  (jO 

> 

o> 

3033333333 

~~ 

(jp  O 3 Cd  (S  <3  ® (9 

1.  The  Items  contained  on  this  form  are  designed  to  measure  student 

> 

3 o 3 3 3 Iff)  (» ifn  dh  db 

z 

attitudes  toward  Air  Force  technical  trainir>g. 

2.  The  form  is  intended  to  give  you  the  opportunity  to  help 
Improve  student  training. 

3.  It  is  very  important  that  your  answers  reflect  your  true  feelings. 
This  is  not  a test  and  you  ere  not  required  to  put  your  name  on 
the  form. 

4.  Please  carefully  follow  the  instructions  at  the  beginnir>g  of 
each  of  the  four  mein  sections  of  this  form. 
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SECTION  1; 

1.  Befow  art  itatemants  describing  rewards  a student  might  receive  if  he  performs  weii  in  technical  training. 

7.  Beside  each  statement  are  two  aeparate  rating  scales. 

On  Scale  1 ir>d<cate  how  likely  >t  is  for  you  to  receive  the  reward  if  you  perform  well  in  training. 

On  Scale  2 indicate  how  important  the  reward  is  to  you.  Consider  only  its  importance,  not  bow  likely  or  unlikely  you  are  to 
receive  the  reward. 

3.  Notice  that  each  scale  has  five  circles.  The  words  above  the  scales  describe  the  meaning  of  the  circles  at  the  ends  of  each  acale.  The 
three  circles  in  the  middle  of  each  scale  represent  feelings  between  those  described  at  the  scale  ends.  You  might  want  to  think  of 
each  scale  as  similar  to  a thermometer  lying  on  its  side. 

4.  Answer  each  item  by  darkening  one  circle  on  each  scale  to  indicate  how  you  feel  about  the  *iaten>ent.  Read  each  statament  carefuHv 
and  take  all  the  time  you  need. 


1 . Increased  job  security  after  graduating  from 

technical  school 

2.  Faster  promotion 

3.  Greater  chance  to  participate  in  important  de- 
cisions after  graduating  from  technical  schoi 

4.  More  challenging  duty  assignments  after 

graduating  from  technical  school 

5.  More  job  responsibilities  after  graduating  fn 

technical  Khool 

6.  Greater  chaiKe  of  bair>g  skilled  and  competi 

in  your  career  field 

7.  Increased  chance  of  getting  a good  civilian 

job  a*ter  Air  Force  service 

8.  Greater  chance  to  be  assigned  to  your  base 

of  choice 

9.  Increased  off  duty  prrvilagti  (for  example, 
three’day  passes  or  no  squadron  detail) . . . 

10.  Greater  freedom  in  deciding  how  to 

accomplish  class  work 

11.  I ncreesed  chartce  of  being  admired  and 

respected  by  fellow  ituder>ts 
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SECTION  1;  SCALE  1: 
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SECTION  II: 

1 . PiMM  UK  th<  inlM  Mow  to  dMcrIM  your  SSAN  of  moln  OoodI  Intiructor. 

2.  Dorktn  Hit  ont  cirelt  on  ««ch  icolt  tfitt  boot  •xproMM  your  fMlnat. 
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»»»««>•(»«»(»  aiCTION  HI. 

t.  tftQW  ATf  • (frli 

S 3.  ^iMM  dtftitn  tt 

^p  ^p  ^P  ^P  ^p  ^p 

I 

47.  Ctrtiln  Mudinn  *rt  hoMili  tetMrd  oth«r  cKM  mimbwi 


I . Iflow  wt  • mrlit  of  itiMnMnti  rfliad  to  both  your  tnlnlng  ond  training  tnvironmont. 
3.  hiMM  dorhtn  tho  ont  olrolo  on  ooch  icolo  that  boat  tapraaMa  vour  faollnia. 


Dtfinittly 

Oliarat 


CD  CZ3  c:d 


Dtfinittly 

Agrat 

CD 


Moat  atudanta  got  along  ««tll  togtthtr . 


49.  FtllOMf  atudanta  look  out  for  aach  othar 


SO.  Carttin  atudanta  art  unoooparttivt 


CD  O C3 


SI.  Ctrtain  atudanta  art  raaponalbla  for  patty  qutrrala  and  bad  taallnga  among  data  mambara.  . . . 


CD  CDS  CD 


S3.  Thara  art  tanalona  among  aoma  atudanta  whieh  Intarfara  with  training  tetivltlaa 


S3.  Carttin  atudanta  ara  Ineaptbla  of  working  togtthar  , 


64.  Studanta  halp  taeh  othar  to  Itarn  lha  naeatatry  oouraa  mttarlal. 


SB.  Soraa  atudanta  art  not  llktd  or  teetptad  by  fallow  atudanta  . 


CD  CD  CD 


6.  Studanta  hava  to  taka  tdvtntaga  of  othtra  In  ordtr  to  auocaad  In  training 


S7.  Studanta  art  ghran  an  aquti  opportunity  to  dtmonatratt  thair  oapabllltlaa 


B.  Studanta  art  aubltot  to  atrlotdltolpllna. 


SB.  Studtnl  training  It  too  olotaly  tuparvittd. 


SO.  Studanta  art  anoourtgtd  to  tptak  thair  mindt  bran  If  It  mtant  dittgraaing  with  tht  Inttructort . 
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61.  Studanta  art  anoourtgtd  to  auggttt  Improvtmantt  or  tolutlont  to  training  problamt . 


CD  CD  CD 


S3.  Studanta  art  anoourtgtd  to  partlelptta  In  eittvoom  diteuttlont 


S3.  Studanta  art  givtn  tha  opportunity  to  ptrticipata  In  oltta 
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S4.  Studtnt  tuggtttlona  and  rteommandatlona  art  aontidartd  with  ftlrnaat 
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S6.  Studanta  ara  aaldem  abla  to  uaa  thair  own  ludgmant 
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SS.  Studanta  hava  no  aay  about  what  htppana  to  thorn  , 


67.  Studanta  hava  llnla  ehanca  to  Influanoa  tha  way  tht  oltta  It  eonduotad 


SS.  Studanta  hava  tha  fraadom  to  attabllth  thair  own  ttudy  tohaihiiat 
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S.  Spart  tima  In  elatt  may  bt  tpant  at  taeh  ttudtnt  tttt  fit . 


70.  Studanta  art  rtrtly  givan  tha  ehtnet  to  fratly  taprttt  thair  Idaat  In  tht  citatroom 
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SECTION  III: 


Dtfinitvty 
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Parformanca  standards  ara  unraatonably  high 
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Thara  is  a good  daai  of  disagraamant  on  how  this  training  should  ba  conducted 
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Tha  student  workload  is  too  heavy 
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Training  hours  ara  too  long 
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Trainingaquipmant  (including  trainers)  it  adaquata 
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Tima  allowed  on  training  aquipmant  (including  trainers)  is  sufficient 
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99.  CItssroom  lifting  it  adequatt . 


SECTION  Ml: 


Dafinitalv 

Oitagraa 


Daflnitaty 

A«rw 


100.  Ctaairodm  chairs  art  comfortabit 


101.  Clataroom  Mating  arrangamant  it  Mtitfactory 


O CD 


102.  Length  of  class  breaks  is  about  right 


103.  Number  of  clast  breaks  it  sufficient . 


104.  Study  facilities  outside  the  classroom  are  adequate  . 


CD  CD 


105.  Classroom  ventilation  it  about  ri^t . 


106.  Time  allowed  for  testing  it  sufficient  . 


107.  Classroom  noiM  control  is  affective  . 
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CD  CD 


10B.  Classroom  work  space  is  sufficient  (desk  or  table  top  area) 

f09.  Supplementary  ttuefy  meterlelt  Imenuelt.  ngutstlont,  technicei  ord^i,  etc.)  art  raedily 
available  for  student  


CD  CD 


no.  Base  recreation  facilities  are  adequate. 


111.  Off  duty  study  time  is  sufficient. 


112.  Time  allovMd  for  review  of  tests  it  adequate  . 


113.  Enough  training  time  is  spent  on  difficult  and  Important  sub|ect  mattar . 


114.  Some  students  would  perform  better  on  a different  shift ' 

SECTIONT IV:  ' 

1 . Bfiow  are  statements  about  your  satisfaction  with  your  tra(nii>g  end  career  field. 

2.  PleaM  darken  the  circle  that  best  expresses  your  feelings  about  the  statement  in  the  same  vMy  you  have  in  the  other  i 


115.  How  do  you  feel  about  your  technical  training? . 


Completely 

OiSMCisfied 


CD  CD 


116.  How  do  you  feel  about  your  assigned  cereer  field? 


1 1 7.  How  do  you  feel  about  the  Air  Force? 


CD  CD  CD  CD 
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SECTION  IV: 

118.  How  similar  is  your  assignad  caraar  fiald  to  yOur  prafarrad  caraar  fiald? 

1 19.  How  accurata  was  tha  information  you  racaivad  about  your  caraar  fiatd  bafora  antaring 

tachnical  trainirtg? 

120.  What  affact  has  tachnical  trainiAfl  had  on  your  faaiings  about  your  caraar  fiald? 

121.  if  you  hava  tha  chanca,  will  you  changa  to  anothar  caraar  fiaid? 
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